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ABSTRACT 


A systems analysis of the processes involved in the esti- 
mation of future military needs is presented. A conceptual 
model of the estimation procecure is formulated and illus- 
trated. Several applicable methods are examined in the 
context of practical approaches to the needs estimation 
problem. These methods are then evaluated in the framework 
of the conceptual model. Finally, a coordinated procedure 
is developed which combines several of the most valuable 


characteristics in the individual methods. 
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L. “GGRODUGMION 


A. BACKGROUND 

The process of acquiring major weapons systems for the 
Department of Defense (DoD) has been the subject of severe 
criticism in recent years. Reports of widespread "“gold- 
plating" and "“cost-overruns" in excess of $30 Billion have 
prompted investigations by the General Accounting Office 
(GAO) as well as several independent study groups [Ref. 1]. 
The findings of these investigations have indicated that 
one of the principal causes of difficulty is a failure to 
adequately identify needs before embarking on new programs. 
Former Deputy Secretary of Defense David Packard stated 
"The most certain way to waste resources is to spend hundreds 
of millions of dollars on a (weapon system) development and: 
then conclude we will not need what we are developing" 

WRef. 2, p. 2]. 

Since most major acquisition programs are initiated to 
provide replacements for existing systems, the specific re- 
adtenchits for them are often simply assumed to be valid 
without an investigation of their value in a projected force 
structure context. Mr. Packard suggested that this tendency 
to "think more in terms of what was effective in the last 
war rather than ... what might be needed for the future" is 
a primary cause of development difficulties, and he concluded 


that "no viable decision can be made on which weapons should 





be developed without knowing in considerable detail what 

kind of forces will be needed for the future" [{Ref. 2, pp. 2, 
3]. The GAO concurred by further commenting that "Our study 
of the history of a fairly large sample of weapon systems 
meeecs us towconelude that the function of deciding which 
weapons will be developed is not yet being done with the 
degree of effectiveness that this important function warrants" 


fret. 3, p. 71). 


B. PURPOSE AND APPROACH 

This paper is the first half of a two part study designed 
to develop an effective procedure for estimating future 
military needs and compare it with actual DoD policies and 
practices in order to determine means for improving them. 
since most of the applicable DoD policies are currentiy 
undergoing revision, the portion of the study which addresses 
them is being temporarily deferred until they are officially 
redefined. This segment, therefore, is concerned only with 
the development of a generalized procedural approach. 
Specifically, its purpose is to systematically identify and 
analyze the requisite components of an effective procedure 
for estimating future military needs as a basis for the 
planning of exploratory research and development (R&D) 
efforts. 

In their findings on the Weapons Systems Acquisition 
Beecesse both the Blue Ribbon Defense Panel and the Commis- 
Sion on Government Procurement made several broad recommen- 


dations on how such a procedure should be developed. These 








recommendations, as interpreted by the author, may be 
Summarized as follows: Military needs should be estimated 
and evaluated within mission areas of the total Defense 
structure and should be expressed in terms of capabilities 
and concepts rather than systems and hardware [Refs. 4 and 
D1. 

In the process of investigating the components of an 
effective estimation procedure, this study examines three 
separate facets of the problem: what elements and processes 
are involved; what methods are available for dealing with 
them; and how these methods can be most productively utilized. 
The investigation is conducted in the context of a conceptual 
model for estimating needs which is developed 26 illuminate 
a systematic procedural methodology through the use cof a 
decision theory approach involving the processes of assess- 
ment, analysis, synthesis, and evaluation. The study com- 
mences in Chapter Two with a discussion of the inputs to 
the model. Next, the several processes involved are intro- 
duced and analyzed. Finally, a hypothetical method of 
operation for the noel is presented. 

The third chapter deals with the exploration of several 
different methods which have been developed to deal with 
the types of problems encountered in needs estimation. 

They are presented in terms of their actual application in 
this area. 

The fourth chapter begins with a comparative evaluation 


of the previously introduced methods. It continues with the 


IL 





development of a compoSite proceduvaleapproach which 
combines selected aspects of the individual methods. 

The final chapter summarizes the results of the study 
and suggests several areas in which further analysis would 


be particularly beneficial. 


ala 








II. CONSTRUCTION OF A CONCEPTUAL MODEL 


A. INTRODUCTION 

Since the estimation of future military needs is accom- 
plished within the overall context of force planning, a 
survey of the general characteristics of this field provides 
insight into the factors and actions involved. Former 
Secretary: of Defense Melvin Laird stated that “Acceptable 
force planning must be based not only on a definition of 
our objectives, but also on a sophisticated analysis of the 
nature and relative importance of the various implements and 
obstacles to the achievement of our objectives" [Ref. 6, 

p. 25]. While this statement does not reflect the tremen- 
dous Gifficulties involved in the force planning process, 

it does point out some of the factors which must be included. 
In this study, these factors (objectives, strategies, and 
capabilities of friendly and enemy forces) are treated as 

meme aryputS to a conceptUal model which™utilizes them'to 
develop statements of future military needs. 

In order to develop the characteristics for the concep- 
tual model, it is necessary to begin with a description of 
its desired output. For the purposes of this study, this 
output (future military needs) may be defined as requirements 
for new and/or improved capabilities which will correct 
Eaeet ea deficiencies in the military's ability to achieve 


its objective in the face of anticipated opposition. Since 


itz 





the statements of these needs are designed for use by R&D 
planners, they should contain some rather specific information 
of the following description [Ref. 5]: 

a) A statement of the deficiency te be corrected and the 
various concepts that appear to merit exploration in 
this regard. 

b) The important objectives to be met by a responsive 
development effort, including general capability, 
evallabelity, and cost goals. 

c) The operational/environmental constraints that must 
be considered; such as size, simplicity, and intended 


usage. 


be tHe INPUTS 

While not an input per se, the environment has such a 
pervasive impact on the specified inputs that it is most 
appropriately discussed in this context. It may be defined 
as the total situational framework within which ALL elements 
anc processes of the model are specified and implemented. 
Although the term scenario is normally associated with this 
definition, it is felt that environment is a more represen- 
tative description of the comprehensive nature of the situa- 
Tional information required for meaningful specification 
of the inputs to the model. Examples of important parameters 
which must be included are the political, economic, and 
sociological conditions which are expected to exist during 


a period 10-15 years in the future. Since these parameters 
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comprise the frame of weference for the oWher aspecus ot 
the model, their determination is one of the most critical 
tasks in the development process. 

The inputs themselves are separated into three basic 
types: objectives; strategies, and capabilities. Altnough 
there are different sets of these inputs for the two opposing 
merces in the model, the characteristwes of @ particular 
type of input are assumed to be independent of a "friendly" 
or "enemy" designation. The inputs are discussed in this 
chapter, therefore, without differentiation of the particular 
force involved. 

Objectives, in this analysis, are defined as the military 
goals established to implement national security policy. 

They may vary greatly in both generality and importance 

and are highly sensitive to the environment. For instance, — 
an aircraft carrier in the Caribbean might have a broad 
minor objective of conducting general surveillance during 
routine operations whereas, in atime of crisis, it might 
have the specific and major objective of deterring Cuban air 
attacks against its ne LeIwore. 

It is, therefore, necessary that the full range and 
hierarchy of objectives which apply in a particular situation 
be enumerated when specifying this input to the model. It 
is also important to examine their sensitivity to the envir- 
Onment so that appropriate modifications can be made when 


different environmental conditions are examined. 
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Another type of input to the model is capabilities. 
These are defined as the means used by the military to achieve 
its objectives. An example, might be the capability which 
an aircraft carrier possesses for projecting firepower 
against distant targets. Since capabilities are closely 
related to specific systems, such as combat aircraft in 
this example, they can be concretely specified in a particu- 
lar situation more easily than objectives. It should be 
noted, however, that this statement does not imply 4a one- 
to-one correspondence between capabilities and systems. 

Some capabilities may require the simultaneous use of 
several different systems, while some systems may be able 
temprovide multiple capabilities. It is, consequently, 
necessary to examine the relationships which exist between 
the relevant capabilities and systems when specifying this 
input to the model. 

Strategies are the methods by which capabilities are 
utilized to pursue the achievement of objectives. As such, 
their primary purpose is to provide a coordinating interface 
between the other Gio Lyoes of inputs so that the intentions 
and actions of each force in a given situation can be deter- 
mined and analyzed. Like objectives, strategies may vary 
widely both in generality and in sensitivity to the environ- 
ment. For the aircraft carrier in the Carribean, a broad 
major strategy under normal conditions might be to monitor 
the sea and air traffic entering and leaving Cuba. During 


tense periods, however, a specific minor strategy might be 


ike 





to avoid complications by keeping the area clear of friendly 
air traffic. Since strategies are highly dependent on both 
objectives and capabilities, as well as the environment, the 
effects of these other inputs must be carefully considered 


me their specification. 


C. THE TRANSFORMATION PROCESSES 

There are four different transformation processes in 
the conceptual model. The first involves a comparative 
assessment of the inputs in order to discover where signi- 
fiecant deficiencies occur as a result of unfavorable imbal- 
ances between the friendly and enemy forces. The second 
process concerns an analysis of these deficiencies to 
isolate the particular capabilities that require improvement. 
The third deals with the synthesis of alternative concepts 
for providing such improvement. Finally, the last process 
involves iterative evaluations of these concepts under four 
important types of considerations. 

The comparative assessment process is most easily dis- 
cussed in terms of specific interactions between opposing 
forces. It entails a detailed analysis of the inputs in 
order to determine the respective intentions and tactics 
of the opposing forces. This data is then used to compare 
the relative strength and effectiveness of the forces in 
order to discover where friendly deficiencies occur. 

The analysis of deficiencies in order to isolate the 


particular capabilities involved is a less complex task 
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than comparativeeassessment, but is often more e@iffieuit. 
It requires the translation of data in terms such as numbers 
of aireraft wdestmoyed. ommeameounts ef te nmi tory eho sieaimio 
meaningful information concerning weaknesses in specific 
capabilities. Once this has been accomplished, the isolated 
weaknesses are further analyzed to determine whether they 
are most appropriately corrected by an increase in the quan- 
tity or an improvement in the quality of forces. Since this 
study is oriented toward R&D planning, only those deficien- 
cies which indicate a need for developmental improvement 
are pursued. 

The third process which occurs in the model concerns 
the synthesis of alternative concepts for correction of the 
capability weaknesses that have been isolated. These con- 
cepts are necessarily very general in nature and should in- 
clude innovative as weli as traditional methods for provwanne 
the type of capability involved. Also, their range should 
be as broad as possible in order to counteract the normal 
military tendency to focus on a single "preferred" approach. 

Fhe iterative evaluations eecur ase result of feur 
different types of environmentally related considerations 
Paicheatiect thesvalidityeod the cencepts synthesized an 
the preceding process. Their purpose is to eliminate those 
concepts which are clearly invalid and to provide amplifying/ 
qualifying data for those which are approved for inclusion 
in needs statements. Although they are discussed and illus- 


trated in an apparently sequential fashion, they should be 
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performed simultanecusly in order to examine the trade-offs 
involved. 

The first type of evaluation deals with the operational 
usability of a concept. It is vitally important because 
Che investment in a deveiopment based on an unusable concept 
is ultimately wasted. An example of such a situation in- 
volved the projected utilization of the C5A. An extensive 
development effort was undertaken to provide this aircraft 
with an expensive specially constructed landing gear system 
for use on both concrete and dirt runways. This effort was 
in response to a clearly unrealistic concept of utilizing 
this extremely large and vulnerable aircraft to transport 
troops into unimproved forward areas. In order to prevent 
such problems, it is necessary to evaluate proposed concepts 
in light of the operational conditions involved in their 
anticipated usage. 

A second type of evaluation concerns the technical feasi- 
bility (including performance, cost, and schedule considera- 
tions) for a particular concept. The question here is 
whether an Reeth) au aaeaeen based on the concept could be 
developed for an acceptable cost in the time frame desired. 
This evaluation entails a survey of projected technology in 
applicable fields as its primary source of information and 
involves extensive trade-offs between the three parameters 
concerned. 

An example of the need for this kind of evaluation 


concerns the concept for the supersonic transport (SST) 
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which was developed by Boeing in the 1960's. As a result 

of many difficult engineering problems, numerous schedule 
delays, and skyrocketing costs, its development was finally 
terminated after the expenditure of vast amounts of time and 
money. 

The third type of evaluation process involves the stra- 
tegic considerations that may be involved in the enemy res- 
ponse to a particular development effort. <A concept that is 
expected to evoke a strong or dangerous response may not be 
tenable in this context. The need for this type of evalua- 
tion is clearly illustrated in the controversy which surround- 
ed the development of the anti-ballistic missile (ABM) in 
the middle 1960's. While many proponents of this tremendously 
complex and costly system argued that it was vital to the 
nation's defense, its critics felt that it was not a tenable 
concept. They argued that it would undoubtedly promote further 
armament escalations and would consequently be quickly 
neutralized by compensatory enemy developments. 

The final type of evaluation in the model concerns the 
domestic political a eee associated with develop- 
ments based on a particular concept. The question is whether 
a concept might involve implications that would be considered 
unacceptable by the electorate and/or Congress. An example 
of this type of situation can be Pew. SS the abandonment 
et the Navy's Fast Deployment Logistics Ship (FDL) concepu-. 
DoD presented this concept as a necessary and cost-effective 


improvement to the Sealift capability. It encountered 
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political opposition in two major areas, however, which 
ultimately forced its cancellation. First, commercial 
Shippers united in opposition to the FDL because they feared 
meswould curtail DoD's use of civilian carso carriers. “ieee 
several Senators feared that the concept would encourage 
undesirable U.S. involvement in "police-action" conflicts 

by making the movement of troops and supplies into overseas 
areas too fast and convenient for the exercise of adequate 
mestraint. 

Those concepts which are considered worthy of explora- 
tion after evaluation are combined with the deficiency they 
are to correct and appropriate amplifying/qualifying data 
into a statement of need as described in the introduction 


GO this chapter. 


D. A MODUS OPERANDI 

The general flow of operations in the model and the 
emaracteristics associated with each section are depicted 
Meee ieures J] and 2 respectively.y In order to illustrave 
this methodology more clearly, the following simple hypo- 
Metical example is presented. 

As part of an analysis undertaken to determine the quick 
response effectiveness of U.S. general purpose forces in 
the environment projected for the 1983-1988 time frame, a 
specific environmental situation is considered in which U.S. 
Marine amphibious forces are engaged in a police-action 


COonrlict Wwitheeray forces in progection of a small suse 


20 





ENVIRONMENT 


ae “NI F NZ 





. / 
a 
Ose sas STRAT HGS ~ CAPABLE MITES 


FRIENDLY 
DEFICIENCIES 





. FORCE LEVEL | 


CAPABILITY 


a 
A i Ol 





4 


CORRECTIVE 
| CONCEPTS 
OPERATIONAL 
USABILITY 
l TECHNICAL 
FEASIBILITY | 
| TERATI 
VALUATIO 


STRATEGIC 
Thee LT Y 
Figure 1. CONCEPTUAL 


: MODEL 
J POLITICAL FLOW CHART 


EPTABILITY 


FUTURE NEEDS 


ol 





Process 


moecatication 
OL 
impu Gs 


Comparative 
Assessment 


Analysis 


Synthesis 


iterative 
Pa luations 


Figure 2. 


Product 


Environment 


Objectives 


Strategies 
Capabilities 
Friendly 
Deficiencies 


Capability 
Weaknesses 


Corrective 
Concepts 


Operationally 
Usable Concepts 


Technically 
Feasible 
Concepts 


strategically 


Tenable 
Concepts 


Pole teally 
Acceptable 
Concepts 


22 


Characteristics 


Comprehensive scope, 
highly uncertain 


Hierarchical, sensitive to 
environment 


Link objectives to capabilities 


Complex capability-system 
relations 


Many elements, complex 
interactions 

Translation and categorization 
Broad and innovative in scope 


Anticipated Utila zavion 


Projected availability of 
technology 


Perception of enemy response 


Congressional attitudes 


CONCEPTUAL MODEL CHARACTERISTICS 





oil-rich Middle Eastern nation. An in-depth analysis of this 
situation aids in the specification of the objectivessestrat— 
egies and capabilities of both opponents. A comparative 
analysis of the forces involved indicates that the American 
force is suffering casualties at an unacceptable rate. 
Further investigation reveals that the apparent reason for 
the losses is an imbalance in the air support available 

to the two opponents. Specifically, the Arabs possess a 
Soviet-built close air support aircraft against which the 
American forces cannot adequately defend. An analysis of 
this deficiency reveals that it is not feasibly correctable 
through increases in force levels due to the non-existence 

of an adequate air defense capability or sufficient friendly 
air support in the environment involved. It is determined 
that the deficiency results in a 75% probability of survival 
from a single air attack and a 50% probability for successful 
conduct of sustained operations. An improvement in capa- 
bility is desired which will increase these probabilities 

to 95% and 75% respectively. It is predicted that any one 

of a number of BiaEeant coneepts for providing the improved 
capability would be both operationally usable and technically 
feasible. Additional evaluations are performed to discover 
the effects of any strategic or political implications which 
may be involved. When they are determined to be negligible 
in all respects, the following statement of need is developed 


and promulgated to the R&D community. 


25 





a) 


b) 


e) 


A need exists for an advanced syscem oO pmor-er 
amphibious ground troops against air attack. While 

no currently projected systems are adequate, various 
concepts involving field operated missiles, laser 
weapons, or electronic countermeasures (ECM) devices 
appear tO merit considerarion. 

The goal for a responsive system is provision of a 

95% pmebability of survival from a single air attack 
and a 75% probability for the safe conduct of extended 
Operavions in a vulnerable environment. The single 
attack survivability criteria is considered more 
important than the criteria for extended operations. 
The capability should be available in the 1985 time 
frame and development efforts should be funded within 
the constraints set forth for normal exploratory/ 
advanced development projects. 

Since the capability should be provided by a system 
that can be operated by front line troops in the field, 


such a system should be easily transportable, relatively 


maintenance-free, and operable by individuals with a 


minimum of formal training. 
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III. INVESTIGATION OF ABRPLIGCABLE MEBs 


ee INTRODECTION 

The conceptual model developed in the previous chapter 
is rather difficult to "operationalize" due to a number of 
different problems. These problems arise primarily from 
three sources: The difficulties involved in adequately 
specifying the inputs; the tremendous complexity of the 
included processes; and the general uncertainty innerent 
in long-range estimation efforts. A number of different 
approaches to the tractable management of these problems 
have been developed. 

The purpose of this chapter is to introduce several of 
these approaches as illustrations of alternative methodolo- 
gies for the estimation of future military needs. As shown 
in Figure 3, there is considerable variance among these 
methods in usage and mathematical rigor as well as in pro- 
cedural approach.- Although the various approaches are not 
explicitly compared or evaluated in this chapter, it should 
be emphasized that the reason for introducing them is to 
@emonstrate several tools which could be useful in the con-= 
struction of a composite approach in the framework of the 
conceptual model. 

Since the examples presented here are relatively con- 
densed and abbreviated, readers who are especially interested 
in a particular approach are encouraged to consult the 


appropriate reference for a more thorough treatment. 
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B. THREAT/RESPONSE 
The traditional process of determining needs in DoD is 
based upon the assessment of a threat and the proposal of 
development concepts to counter it. Almost every require- 
ments document published by the Department references some 
type of threat analysis as its justification [Ref. 7]. It 
is appropriate, therefore, that the first method discussed 
in this chapter should involve a variant of this procedure. 
The approach employed in developing a draft of the Technology 
Coordinating Paper for weapons development (a document being 
published by the Director, Defense Research and Engineering) 
was chosen for this purpose because it is substantially 
independent of environmental considerations. Whereas 
most attempts at threat assessment are based on a detailed 
description of the environment in which the assessment is 
made [Ref. 8], this approach is more concerned with an 
objective evaluation of the characteristics of comparable 
weapons. These evaluations are made in the following four 
contexts. 
a) Ina face-to-face comparison of a friendly weapon 
VemoUSNohmCMomy came, threat is constituted by 


ot 


higher survivability of the target. 


toe information concerning this approach is based on 
personal interviews with Dre. KON. Stolii of the Naval 
Postgraduate School who coordinated development of the 
threat analysis for the document involved. 
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b) In a face-to-face comparison of an enemy weapon 
against a friendly tarmgereethreat is (consbanumed by 
extreme vulnerability of the target. 

c) In a side-by-side comparison of the performance 
characteristics for similar friendly and enemy weapons, 
threat is constituted by superior performance of the 
enemy weapons. 

d) In an evaluation of projected enemy weapons technology, 
threat is constituted by anticipated innovative advances 
Or breakthroughs. 

In the Weapons Technology Coordinating Paper, the 
threats (see Figure 4 for example) identified by this pro- 
cedure provide the rationale for a survey of weapons-associ- 
ated technology. The objective of this survey is a determin- 
ation of the ability of the technological fields concerned 
to provide new/improved systems which show promise of 
effectively countering the identified threats. 

While this procedure has obvious drawbacks, including 
its failure to consider the effects of quantity/quality 
tradeoffs, it does offer an interesting method for elimin- 
ating the "scenario dependancy" which is inherent in most 


threat assessments and requirements statements. 


CG. DELPHI 

An interesting Delphi-type approach to needs estimation 
can be found in A Study of Deterrence which pursues the 
following objectives [Ref. 9, p. 1]: 
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PART A: Threat = Survivability of Target 
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Figure 4. THREAT ASSESSMENT EXAMPLE 
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a) "To forecast American defense needs in the decades of 
of the seventies, eighties, and nineties." 
b>) "“Toecompare and analyze national security stravecics 
with national objectives." 
ec) "To relate specific weapons systems or mixes to national 
strategies." 
d) "To evaluate future weapons systems and national 
security strategies with national objectives." 
The approach used in the study employs a combination of the 
Delphi technique and cross-impact analysis. In order to 
facilitate understanding of this methodology, a brief 
description of these two analytic tools follows. 

The Delphi Technique is designed to produce a consensus 
Opinion among 2 group of experts through an iterative process 
of individual interrogations and feedback [Ref. 10]. It was 
developed at the RAND Corporation in an effort to rectify 
some of the biasing effects inherent in group discussions. 
These effects principally concern the tendency for the 
dominant members of a group to monopolize the discussion and 
the pressure for unanimity exerted by holders of the majority 
epirwor. Delphi alleviates these problems by physically 
separating the members of the group and by utilizing the 
devices of anonymity, controlled feedback, and statistical 
group response. These devices provide for several rounds of 
private interviews with each member of the group. During 
the interviews, the members are presented with summarized 


results of the previous round, including the median and 
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deviation of the responses, and are requested to reply with 
revised and/or refined opinions (supported by appropriate 
justification if significantly different from the median). 

This process is generally repeated for three or four iterations 
or until the deviation of the responses is considered suffi- 
clently small. 

Cross-Impact analysis is "a family of techniques that try 
to evaluate changes in the likelihood of .occurrence among an 
entire set of possible future events and trends in light of 
limited changes in probability for some of the items in that 
set" [Ref. 9, p. 32]. It involves the construction of 
matrices in order to enumerate and evaluate the inter- 
relationships which exist among different sets of elements 
(see Figure 5). The combination of this technique with Delphi 
provides a means for simultaneously identifying and evaluating 
both individual elements and the linkages between them. 

The Study in Deterrence uses three sequential applications of 
Gms combination to predict, in turn, the nation's objectives, 
capabilities, and strategies for the period 10-30 years in 
the future. | 

Delphi One is concerned with determining and scaling "the 
specific goals and objectives of the United States in the area 
of National Security Affairs" [Ref. 9, p. 3]. It approaches 
this task by dividing National Security Goals into the 
categories of Deterrence, Defense, Maintenance Acquisition, 
and Development (with appropriate specific goals in each 


category as shown in Figure 6). The respondents are requested 
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Procedure: In order to investigate the relationships 


where: 


between four strategies (A,B,C,D) and three 
objectives (X,Y,Z), a cross~impact matrix 
could be constructed and evaluated as follows: 


The effect on achievement of this objective 


would be: 
A 
If this 5 
Stravesy 
were 
C 
pursued: 
D 





+1 to +5 denotes increasingly positive effect 
0 denotes no effect 


-l to -5 denotes increasingly negative effect 


Figure 5. ILLUSTRATION OF A CROSS-IMPACT MATRIX 
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Figure 6. DELPHI ONE 
33 


Value | Priori 


——_ 





to indicate the individual worth of each ¢oal (on ea ¥scaleuce 
-~1 to +3) and its relative priority within the entire set 
(on a scale of 1 to 9). 

Delphi Two has as its objective the determination of the 
strategies which can best assure acnievement of the objec- 
@ives established in Delphi One. It endeavors to discover 
"the possible range of strategic options, and then to scale 
these options in terms of preference, utility, and- probability 
of effectiveness" [Ref. 9, p. 3]. The procedure utilized 
delineates a number of possible strategies and policy attri-~ 
butes (Figure 7) and calls for respondents to evaluate them 
in three different contexts. First, the policy attributes 
are ranked in order of importance (Figure 8). Second, ina 
cross-impact context, the strategies are evaluated against 
the objectives established in Delphi One in’terms of whether 
each of the strategies (in turn) is beneficial, neutral, or 
detrimental to the achievement of each of the objectives 
(Figure 9). Finally, in a similar manner, the strategies 
are evaluated against the various policy attributes in terms 
of the natures Capea. negative, or zero) of the corre~ 
lations which exist between them (Figure 10). 

The objective of Delphi Three is "to determine, in kind 
and quantity, the general weapons system types necessary to 
carry out the optimum National Security Strategies of the 
United States" [Ref 9, p. 4]. The weapons systems are 
divided into categories according to their usage, such as 


"balance" forces, defensive forces, or projection forces. 
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RANKDNGS OR SPOOL al rari S 


This is an attempt to determine preferences as to the 
ordering of importance of policy attributes using a special 
statistical technique. Notice that.the matrix below has 
identical rows and columns, but that only half the matrix 
is provided. Starting with the attribute in row #1, compare 
this attribute to the attribute in every column for which 
there is a square to fill. if the row attribute is 
preferred to the column attribute, place a "1" in the square; 
if vice-versa, place a "0" in the square. Repeat this 
procedure for each row until the half-matrix is entirely 


feed with "1"s and "O"s. 


B C D 
cS S| 
EXAMPLE: Row A: prefer i iow A 
Dto A 
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Figure 8. DELPHI TWO, PART A 
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STRATEGY VERSUS GOAL 


in the matrix below, strategies,are listed as rows and 
Beals-are listed vas columns.  sStartadnge with the stratecy 
in row #1, evaluate the strategy against the goal in each 
column according to the following scoring system: 


1 - the strategy is severely detrimental 
to the accomplishment of the goal. 


2 - the strategy hinders the accomplishment 
of the goal. 
3 - the strategy neither hinders nor 


contributes to the accomplishment of the goal. 


4 - the strategy contributes to the 
accomplishment of the goal. 


5 - the strategy is very beneficial to the 
accomplishment of the goal. 


Repeat this procedure for each row. Remember, each 
strategy is to be considered independently of all other 


strategies. 


G1 G2 G3 Gy G5 
Sl 


S2 
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S4 


95 
Figure 9. DELPHI TWO, PART B 
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The respondents are requested to predict the technologmcas 
feasibility of various concepts for advanced weapons (Figure 
11). They are also asked to evaluate the cross impact cf 
mhnese concepts in terms of thear usefulmess in implementing 
the Delphi Two strategies (Figure 12). 

Although this Study is not yet completed and is therefore 
very difficult to objectively evaluate at the present time, 
it does appear to offer an interesting approach to the 
aifficult problem of predicting such subjective and 
judgemental elements of national security policy as objec- 


tives and strategies. 


D. RELEVANCE TREE 

Planning Assistance Through Evaluation of Relevance 
Numbers (PATTERN) is a procedure designed by Honeywell to 
"help pinpoint which of thousands of possible alternative 
research and development projects are most likely to provide 
maximum payoff in advancing important national-military 
Boyectives" (Ref. “12, p. 56). Its methodology employs a type 
of hierarchal network known as a relevance tree to explicitly 
Peviermine and display the relative importance of different 
specifically defined elements to the achievement of broadly 
defined goals. : 

The PATTERN procedure is initiated with a detailed 
projectivion of the environment for the time frame under 
consideration. Within this context, a relevance tree is 


developed which consists of a three section hierarchy [Ref. 13]. 
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In this Deiphi iteration, rate the capability of various 
types of weapons systems to implement the previousiy 
delineated strategies. It is assumed at this point that all 
of the types of weapons systems listed below are in fact 
feasible. 

In the following matrix, rank the capability of each type 
of weapon system to implement each strategy. A ranking of 
O to 4 as defined below should be used: 

O - No capability. The weapons system is of no use in 

implementing the strategy. 

1 - Slight capability. The weapons system may be 
capable of partially implementing 
the strategy under some circumstances. 

2 - Moderate capability. The weapons system is capable 
of implementing the strategy under 
mesitecireumstances in conjunction 
with other weapons systems. 

3 - Large capability. The weapons system has significant 
capability to implement the strategy, 
but could be replaced by another 


system or combination of systems. 


4 - Essential. The strategy cannot be implemented 
without this type of weapons system. 


WEAPON VERSUS STRATEGY 
el Ge Oe a Ss 


W1 
We 
W3 
w4 
W5 
Figure 12. DELPHI THREE, PART B 
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The upper section is concerned with overall strategies for 
achieving national objectives. It is divided into three 
separate levels which respectively delinate the types of 
Sorerict, forms of conflict, and@ missiotis which are involved 
in the development of these strategies. The center section 
deals with the capabilities that are required to implement 
the chosen strategies. Its two levels consist of the concepts 
and the functional subsystems involved in providing these 
capabilities. The lower section concerns the technological 
considerations involved in the development of the required 
eeapabilities. Its levels include subsystem configuration and 
technology deficiencies. Each of the levels, in turn, is 
broken down into elements which delineate the alternatives 
which are applicable at each level of the tree. 

When a tree has been constructed and broken down into 
elements for each level, a team of experts assigns relative 
numerical values to these elements on the basis of prede- 
termined weighted criteria [Ref. 14]. These values are 
assigned in the following manner. First, the criteria 
involved in a particular section of the hierarchy are given 
relative weights (in accordance with their importance) 

Watch sum to unity for all criteria in that section. Then, 
the elements on a particular node of the tree are assigned 
relative values under each of eneyetta appecatie WO VG. 

These values are assigned in such a way that the sum of all 


the element-criteria valuations on a given node sum to unity. 
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By a serfes of element value multiplications alou. sd 
linear trace "up" the tree, it is ostensibly possible to 
determine the relative importance of upgrading a particular 
element in terms of its individual effect on national 
objectives. 

The following series of figures illustrates the PATTERN 
structure just described. Figure 13 shows the basic struc- 
ture of the tree with suggested general ranking criteria for 
each section on the left and a hierarchy of the levels within 
the sections on the right. Figure 14 provides an example 
of a network structure which displays the elements that might 
comprise the top four levels of the tree. Figure 15 illus- 
trates the numerical relationships among various levels in 
the context of an annotated relevance tree, showing the 
values placed on the elements of each node. 

The numerical values provided in this manner comprise 
the major portion of the PATTERN data base. There are, 
however, two other sources of data which contribute to the 
final determination of relevance numbers for the elements 
in the tree. These elie s are analyses of status/timing 
and cross support. Status/timing concerns the feasibility 
of correcting specific technical deficiencies listed on the 
lowest level of the relevance tree. A technological fore- 
cast, which predicts the future state-of-the art in the 
field(s) of technology concerned, is used as a basis for 


assigning relative vaiues to the deficiencies as a measure 
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Figure 15. AN ANNOTATED PARTIAL RELEVANCE TREE 
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of the probability that they can be corrected in the time 
frame specified. | 

The third component of the data results from a survey 
of the relationships that exist between different techno- 
logical fields. On the basis of this survey, values are 
assigned to the deficiencies to denote the general extent 
memat the correction of a particular deficiency will encourage 
SieeataG the correction of deficiencies in related areas. 

When all of the data has been developed for the three 
steps involved in the PATTERN procedure, it is compiled and 
analyzed through an automated process in order to produce 
a set of relevance numbers which indicates the priorities 
for upgrading individual elements in terms of their value 
to the achievement of national objectives. 

As an indication of the complexity involved in a full 
PATTERN analysis, Honeywell developed and evaluated the 
following hierarchy during a six-month study effort based 
on this procedure. 

sl national objective 

=3 types of activity 

.13 forms of activity 

~46 missions 

.160 concepts 

~425 functional sub-systems 
.850 sub-system configurations 


-200 technical deficiencies 
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While this approach contains a number of specific 
virtues and pitfalls, its primary value in determining needs 
appears to be the methodology it employs for displaying the 
Peneral hierarchical structure rather than prioritizing me 
individual elements. Also, only the top five levels of the 
tree are applicable to the needs estimation problem as 


defined in this study. 


EB. FUNCTIONAL NETWORK 

The functional network approach utilized in the Military 
Requirements Analysis Generation (MIRAGE) studies performed 
by Lockheed attacks the deficiency determination and evalua- 
tion problem from a mission oriented point of view. MThis 
procedure involves the development of extensive networks 
which outline the relationships that exist between missions, 
capabilities, and systems. These networks form the framework 
within which operational needs are isolated and corrective 
concepts are proposed. Their development grew out of a 
study performed at the RAND Corporation which attempted to 
illuminate the difficulties associated with planning for 
general purpose force structure requirements [Ref. 15]. 

The functional network analysis procedure (Figure 16) 
begins with the development of a set of environment scenarios 
which delineate a full range of conflict situations which 
are deemed possible for the time frame under consideration 
(see Figure 17). This information forms the basis for a 


development of the concepts of operation (strategies) which 
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are likely to be employed [Ref. 16]. The next step is a 
Gelineation of the missions which will be required in support 
of these concepts (Figures 18, 19). Each mission leads to 
the development of a detailed series of flow charts which 
outline the various types of capabilities required and weapons 
available for performing the different missions involved. 
Figures 20-22 provide an illustrative example of this process. 
By showing both capability requirements and systems avail- 
ability together, the flow charts readily point out deficien- 
cles which comprise the weaknesses within each mission area. 
These weaknesses are then ranked in terms of their importance 
by use of the following (PATTERN-like) procedure [{Ref. 17, p. 
81]: 

a) "relate the missions by means of relevance numbers." 

b) “assign 'likelihood' values to scenarios." 

c) "combine the values of a) and b) to ascertain relative 

mission needs." 
d) "rank the weaknesses isolated within each mission area." 
e) "combine the values of c) and d) to asecertain relative 
functional needs." 
After the various weaknesses are identified and prioritized, 
detailed technological forecasts are consulted and advanced 
concepts for correcting them are synthesized and evaluated 
for feasibility. 
This procedure possesses a highly desirable character- 

istic not evident in the approaches discussed previously in 


that it attempts to explicitly delineate the tremendously 
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complex inter-reiationships which exists between capabili- 
ties and systems in the area of general purpose forces. For 
this reason it shows promise of being particularly valuable 
in any effort to realistically estimate future military 


needs. 


FF, SIMULATION 

The final approach to be analyzed in the chapter is an 
extremely complex and highly automated force simulation 
system called FOREWON, which was developed by the Research 
Analysis Corporation (RAC) for use in the Army's program 
lemndne process [Ref. 18]. Although this system differs 
from the approaches previously discussed in that it is 
Oriented toward” optimization of force structure rather than 
ioelation of deficiencies, iteprovides insight into a type 
of simulation system currently in DoD usage which might be 
adapted to the needs estimation procedure (see Figure 23 
for a system flow chart). 

The principal input to FOREWON is the Design Group of 
Multi-Theater Operations (DGMTO) which contains a set of 
Meenarios for a particular strategy of multi-theater opera- 
tions. The first operative module is the Preliminary Force 
Designer (PFD) which develops a combat troop list for exe- 
cution of a DGMTO. This list is fed to the more detailed 
Theater Force Designer (TFD), which Senet s of the ATLAS 
combat simulation model, which conducts and evaluates the 


battle, and the FASTALS theater roundout model, which 
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generates support requirements. While the ATLAS results are 
printed out directly, the FASTALS ists are fed anto the Lise 
System Designer (LSD) and the Objective Force Designer (OFD). 
These modules, respectively, generate the design and cost 

for an appropriate transportation system and compile an 
meerall optimalmtroop list. Finally, this optimal troop 

list is fed into the Force Cost Assessor (FCA) which computes 
ena reports the cost of transitioning from an initial force 
to the objective force [Ref. 19]. 

While the system employs highly iterative procedures, 
as illustrated in the chart, a simplified "straight-through" 
version of the operational flow is illustrated by the follow- 
ing example. First, a DGMTO covering several contingencies 
is developed and fed into the PFD. The resulting initial 
Combat troop list is inputted to ATLAS which evaluates its 
combat effectiveness and FASTALS which generates its support 
requirements. These lists are then used by the LSD to com- 
pute transportation requirements and the OFD to develop the 
objective force. Finally, the FCA computes the incremental 
Bests associated with the transition from the initial to 
the objective force. 

Although this discussion provides a very brief descrip- 
tion of the system's operation, it is only intended to illus- 
trate the general character and complexity of the processes 
involved. Since the ATLAS combat simulation model is of 
particular importance to the system's applicability in this 


study, however, its operation merits closer scrutiny (Figure 24). 


a 





PREGAME PREPARATION 


analysis of situation 
inputs aggregated 


DATA REQUIRED 


geographic limits 

opposing strategies 

orders of battle 

operational data from scenario 
tactical air and logistical resources 


OTRUCTURING THE THEATER OF OPERATIONS 


air eemtrel awhhormty 
layout of sectors 
ports of entry 


ORGANIZATION FOR COMBAT 


maneuver units 

artillery support 

close air support 

inactive and reserve units 
scenaric phases 

logistical considerations 


SYSTEM RUN 


immediate interpretations of situation 
(perhaps return to PREGAME PREPARATION) 


RESULTS 
complete analysis* 
* This analysis includes a comprehensive review of all 
inputs, parameters, and objectives. The run might be repeated 
several times in order to achieve satisfactory resuits. 


Throughout the above steps there is an implied recycle 
capability to ensure credible outputs from each previous step. 


Figure 24. SUMMARY OF ATLAS RUN 
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The ATLAS model is actually composed of four different 
submodels (Figure 25): the tactical decision model; the 
logistics model; the tactical air model; and the ground 
combat model. These four sub-models are coordinated in such 
a way that each of them is involved in determining the move- 
ment of the Forward Edge of the Battle Area (FEBA), the 
model's decision variable which basically represents the 
point of contact between the two opposing forces. The 
involvement of each of these sub models in determining FEBA 
movement is indicated by the following assessment criteria 
MrRef. 19, p. 45]: 

a) the firepower of each side after accounting for 
casualties and replacements 

b) the days of supply available to the combat troops 

c) the effects of aircraft assigned to close air support 
(CAS) missions | 

d) the nature of the terrain over which the fighting 
takes place. 

e) the tactical posture of the combatants. 

The FOREWON system, and particularly the ATLAS combat 
simulator, possess characteristics which may be desirable 
in the needs estimation process. They appear to be concep-= 
tually adaptable to the difficult task of comparatively 
assessing opposing forces in order to uncover "qualitative" 
deficiencies. Consequently, they will be evaluated more 


deeply in the following chapter of this study. 
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IV. DEVELOPMENT OF A COMPOSITE PROCEDURE 


A. INTRODUCTION 

The second chapter of this study outlined the factors 
and processes which should be included in a thorough and 
comprehensive procedure for the estimation of future military 
needs. The third chapter presented several applicable 
methods for approaching the needs estimation problem, as 
illustrated by actual examples of their usage in this field. 
The purpose of this fourth chapter is to evaluate these 
various approaches in the framework of the conceptual model 
in order to determine a composite procedure which combines 
the most desirable aspects of the individual methods. 

The first section of this chapter is devoted to a com- 
parative analysis of the various approaches presented in 
Chapter Three. They are evaluated both in terms of their 
own particular advantages and disadvantages as separate 
Meedssestimation precedures and in terms of their interface 
with the conceptual model presented in Chapter Two (refer 
back to Figures 1 and 2 for a summary of the model). 

The final section of the chapter attempts to combine the 
advantageous aspects of the individual methods into a coor- 
dinated approach which satisfies the requirements embodied 
in each section of the conceptual model. It concludes with 
an example of how this procedure might be applied in a 


hypothetical environment. 
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B. EVALUATION OF INDIVIDUAL METHODS 

Each of the methods introduced in the previous chapter 
has its own peculiar advantages and disadvantages for appli- 
cation to the task of estimating needs. This section dis- 
cusses the pertinent characteristics of these methods in 
order to determine their particular usefulness in the esti- 
mation of needs and their consequent applicability to the 
various components of this study's conceptual model. 

The most readily apparent general attribute of the Threat/ 
Response method is the fact that it is understood and accepted 
as the result of long usage. It is also a relatively simple 
and straightforward process to perform, since appropriate 
data on enemy capabilities and systems is fairly readily 
available from the intelligence community. As mentioned 
previously, a unique and valuable advantage of the particular 
variant of this method used in the Weapons TCP is that it 
is NOT scenario dependent. On the negative side, the Threat/ 
Response methodology does not provide for consideration of 
the trade-offs between increases in numbers versus improve- 
ments in quality of weapons. It also does not address the 
importance of a particular threat in terms of overall 
national security. These considerations tend to promote 
"worst case" planning in which an attempt is made to counter 
all perceived threats individually and simultaneously. 

In terms of the model, this method's treatment of capa- 


bilities is good, but objectives and strategies are ignored 
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and, as noted, environmental consideratienssarerelitinarecr 
It offers a crude but fairly simple comparative assessment 
process which is valuable in isolating strictly qualitative 
deficiencies in "one-on-one" type situations. Its conclu- 
sions, however, are often misleading since they do not 
consider quantity/quality trade-offs. Its provision fee 
the evaluation of corrective concepts is oriented toward 
technical considerations exclusively and completely ignores 
important operational, strategic and political questions. 

tne Welpha method, as illustrated bY Ah Study tneveroumemeace 
Contains several desirable characteristics for inclusion in 
a needs estimation procedure. It provides a comparatively 
"bias free" methodology for utilizing a consensus of expert 
Opinion in the prediction and/or evaluation of difficult 
to quantify factors and considerations. It also provides 
results which are usually "reproducible," which is a definite 
advantage for a judgemental type technique. On the other 
hand, the quality of its results is highly dependent on the 
expertise of the selected respondents. Also, the device of 
controlled feedback constrains the free exchange of informa- 
tion which prevails in a face-to-face brain-storming session. 

In terms of the model, this method appears generally 
well-suited for the prediction of the judgemental type inputs 
such as objectives, strategies, and the environments. It 
also shows promise in the evaluation of concepts for opera- 
tional usability, technical feasibility, strategic tenability 


and political acceptability. Its main drawback in terms of 
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the model is that it offers no adequate method for the 
matching of capabilities to systems or the comparative 
assessment of opposing forces with subsequent identification 
of deficiencies. 

The Relevance Tree methodology used in PATTERN is theo- 
retically well adapted to the task of estimating needs due 
to its well defined hierarchical structure and provision for 
establishing the relative importance of alternatives. Spe- 
cifically, it provides a systematic procedure for the identi- 
fication and prioritization of particular technical deficien- 
cies which threaten national security. This procedure, 
however, utilizes a numerical weighting methodology (as 
depicted in Figure 14) which implies an unrealistic degree 
of precision. Relevance numbers provide a valuable tool for 
ranking limited numbers of distinct alternatives, but it does 
not appear reasonable to assume that they can provide (as 
PATTERN suggests) a clearly defined ordering of priorities 
for 2000 different technical deficiencies. 

In terms of one conceptual model, the relevance tree 
method offers an interesting structure for the specification 
of inputs Sut does not contain a well-defined process for 
mew vhney should be specified. It also does not offer any 
means of conducting a comparative assessment Of OppOosSo tne 
forces or nontechnical evaluations of concepts. Its princi- 
pal value for the model, therefore, lies in its well-defined 
hierarchical structure rather than its methodology for 


assigning relative priorities. 
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The Functional Network approach embodied in the MIRAGE 
studies is the only method analyzed which specifically 
addresses the complex relationships that exist between capa- 
bilities and systems. By delineating these relationships 
in a mission flow chart context, it illuminates the various 
strong and weak points in the capabilities of a given force 
seructure. ~ Unfortunately, however, meaningful flow charts 
are tremendously complicated and are, consequently, extremely 
aetficult to construct and/or interpret. 

In terms of the model, the MIRAGE procedure utilizes a 
detailed environmental analysis to determine probable 
"scenarios" and specify the various inputs. Deficiencies 
are isolated strictly through use of the mission flow charts 
and no explicit means of comparative assessment cr nontech- 
nical evaluation of concepts is included. Since all other 
Characteristics of this approach are basically similar to 
those found in PATTERN, its primary unique value lies in 
the comprehensive environmental analysis which initiates it 
and the mission flow charts which relate capabilities and 
systems. | 

The Simulation method used in the FOREWON System is 
unique among the approaches examined because of its emphasis 
on comparative assessment of opposing forces in strictly 
Quantitative terms. It also provides for an iterative ana- 
lytic/evaluation process which can be used in determining the 
nature and extent of deficiencies. Because of its highly 


automated nature and consequent strict requirement for 
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quantified inputs, it entails ’the use of Speciiver deci 
mies in order to eliminate the judgemental aspects of 

combat. Also, because it uses fairly crude techniques to 
analyze extremely complicated situations, it requires many 
simplifying assumptions in order to accommodate its relatively 
low degree of sophistication. 

In terms of the model, the FOREWON approach uses standard 
military intelligence and planning guidance documents as a 
basis for the specification of the environments, objectives, 
Serategies, and @apabailitiesefor the DGMTO. The comparative 
assessment and identification of deficiencies are jointly 
provided by the PFD and ATLAS model during a series of itera- 
tive operations. The analysts must manually alter the force 
structures between iterations in order to analyze the nature 
and extent of the identified deficiencies. No provision 
is currently included for the synthesis or evaluation of 
new concepts, but a procedure for the incorporation of this 
feature is currently under development [Ref. 20]. 

The primary value of the FOREWON approach in the context 
of this study is Ener aCe that it effectively validates the 
structure of the conceptual model. While FOREWON and the 
model are significantly dissimilar in several respects, most 
of these dissimilarities can be directly attributed to the 
distinction between their respective purposes (i.e. mid-range 
force structure planning versus long-range needs estimavaonm) 
It is in the areas most affected by this distinction, where 


qualitative/judgemental considerations are involved, that 
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other methods appear better suited to the needs estimation 
problem. 

The foregoing discussion makes it readily apparent that, 
while each of the individual methods has its own peculiar 
advantageous characteristics, none of them is totally ade- 
quate to perform all of the processes contained in the 
conceptual model (see Figure 26). The next section, there- 
fore, describes a composite approach which selectively 
combines these methods in order to exploit their respective 


benefits in a coordinated manner. 


C. COORDINATION OF COMBINED METHODS 

This section is concerned with the determination of a 
coordinated set of methods to be used in "operationalizing" 
the conceptual model. For the sake of clarity, it discusses 
the methods to be used for the various operations in accord- 
ance with the order in which these operations occur in the 
model (see Figure 27 for a summary). Before the methods 
themselves can be intelligently discussed, however, it is 
necessary to describe the structure in which they are combined. 

The first consideration in the procedural development is 
the question of administration. Since it was stated in 
Chapter One that the approach should be structured in a 
mission-oriented context and should be systematic in nature, 
it should be administered by a group of experienced analysts 
who collectively possess a wide range of expertise in both 


operational and technical fields. The initial task of this 


69 





ITERATIVE 
EVALUATION 


ASSESSMENT 


ANALYSIS 
SYNTHESIS 


SPECIFICATION 
OF INPUTS 


eTqeqgdsooy 
Tete eee 
AQT 1 PQU tiem. Meee, lee 
os ralalic veal (S. 
AYTTFATSeeg| gp. fx, OD o 
TBVoOTUYoSY, 
AYTTFQAesSN| se ms Ps Ps 
Teuotyerzsdg 


stsoeuqudks 
4da0uo0g 


STSATRCUY 
Adustotyoq 
{USUSSOSSY 
SATISBASAWUOD) 











SoT3ttTqedep 
Awsuq}) © 


SSEITLEQedEZ) 
AT pusetay 
SoTZe1yei4s 
Aawseuyg 
Satsaqyea43s 
ATpuetay 
SaeaTtzoelqo 
Awauyq 
SaoAaTtTyoelqo 
AT pustiy 
Fs 


METHOD 


fx] 
fr] 
OC 
tH 
fx] 
Ss 
= 
<< 
> 
fx] 
4] 
[x] 
m 


THREAT/RESPONSE 
DELPHI 
FUNCTIONAL 
NETWORK 





{ce 













SIMULATION 


Poor X = None 


p= 


F = Fair 


G Good 


KEY 


Figure 26. COMPARATIVE SUMMARY OF INDIVIDUAL METHODS 





HOVOUddV ALISOdWOO JO AYVWWAS ‘Le Seansty 


SS eS SSS ae ss SS chs ee elt sve ssseepeervunnnasunemseretvannrunensnnnnneeunganenguvesapnnmesnane 


sqada0u09g eTqegda00y ATTePOT4aF [Od 

; Sqydeou0g eTqeuey ATTeotse4ed4s UOTIENTCAY 

QUT NUIERG, UEICOECICL Ge sqydeou09g eTqtsesey AT [Teopfuyosy SATYSISAI 
Ss4d90uo09 eTqesq ATTeuUCTABAedg 


SUOTAIENTRPAQ TUdTSEq °2 S$4d90uo0g 
SBUIWMIERSUEP Ig. ° Tt DATZIOIATON SfTseuquds 
SUOTSAISAUNY 
FfteCUDO MOTH UOFSSTW “ce 
UOF4eSTNUTS SeSsouyeom STSATCUY 
/stshkTeuy yeeztuy °T AYFETTaeded Aqua FoF jad 
UOTac imate 
/ STS og a 1USsUSSEeSSV 
SUOTSATSAUNDD SeToOueToTiraqd 
42eUD MOTY UOFSSTW “*T AT puetig gee eee 
Sond ei raede® 
: SoFZa4eI14S UuoTAeOTJFoOsdsS 
UOTIePT Ley FudioG “<2 SOATIOELAO andut 
STSATCUY Te4QUSWUOATAUY °T VUSWUOTTAUY 


a SS SS SS SSS sss sg sn a rsp ss si si Ss 


COHLYN LONdOYd j SSdo00ud 


(2 





group is the developmentweol anwamaginative anemeeiorenensive 
environmental analysis (of the type used in MIRAGE) for the 
period 10-15 years in the future. This analysis is vitally 
important because it forms the basic framework for the 
remainder of the estimation procedure. 

The environmental analysis is initially used as a 
foundation on which the analysts hypothesize relevant param- 
eters (including alternative objectives, strategies, and 
capabilities for both opponents) for the probable conflict 
situations identified. These environments and associated 
Peeanatens are then "validated" by a select group of civilian 
and military officials (from the State Department as well as 
all components of DoD) in one of three ways: informal oral 
discussion in a committee atmosphere; formal written 
commentary through the chain-of-command; use of the Delphi 
technique. Because of the difficulties traditionally 
encountered with the first two methods, Delphi is considered 
the most appropriate method for validation. The Panel's 
initial task in this Delphi is to evaluate the possible 
environments envisioned by the analysts, in order to validate 
their realism and likelihood. Next, the panel successively 
identifies in a cross-impact context the appropriate inter- 
sections of the listed objectives, strategies, and capabilities 
of the opposing forces in each of the environments. The 
overall result of this Delphi is the delineation of probable 


conflict environments for the period under consideration; 
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with the likely objectives, strategies, and capabilities 
of the opposing forces specified for each one. 

Taking the information from the validation Delphi as 
input data, the four transformational processes of the model 
Can be initiated. The first stepymithY/this seeticn ofthe 
procedure is the development of mission flow charts with 
which to translate general capabilities to specific systems. 
By comparing the capability requirements provided by the 
Delphi process to the flow charts, the types of systems 
utilized by each opponent in a particular conflict situation 
Com be dewermined. Thds data can them be coordinated with 
opposing strategies to form the input for the comparative 
assessment process. 

If only an approximate and strictly qualitative deline- 
aiiten ofedeficiencies ts needed, the Threat Amalysis method 
can be used. If, however, quality/quantity tradeoff consid- 
erations are involved, the Simulation approach is appropriate. 
By selectively adjusting the parameters between successive 
simulations of a conflict environment, the identified defi- 
ciencies in the ar dewianks force can be individually analyzed 
to determine their respective gravity and urgency. Those 
deficiencies which are not correctable by realistic increases 
in force levels are further analyzed through use of the 
mission flow charts to isolate the capabilities involved as 
a basis for the synthesis of corrective concepts. The 
synthesis process itself is best accomplished in a "brain- 


storming" context designed to produce a broad range of 
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concepts as insurance against the prevalent military 
tendency to concentrate on a single (preferred) alternative. 

Once the initial set of concepts has been synthesized 
for the correction of a particular deficiency, the next step 
is to evaluate and refine it in order to "separate the wheat 
from the chaff" prior to the expenditure of time and money 
on R&D efforts. The four types of evaluations required are 
optimally performed by experts from.the operational, techni- 
@al, strategic, and political fields, respectively. They 
can be performed in any one of three different ways discussed 
for validation but also appear to be most appropriately 
accomplished by the Delphi process. 

In order to identify and analyze the various trade-offs 
between them, all four types of evaluations should be made 
simultaneously. The selected experts are requested to 
evaluate, in the context of their own fields, the alternative 
concepts for correcting a particular deficiency and to 
recommend any other concepts which they may deem appropriate. 
After several iterations of interview and mutual feedback 
among the various foe cuetiere on the panel, a set of concepts 
os generated and evaluated which is considered viable under 
eu 1Olme Se€tCsS Of criteria. 

For purposes of clarifie@ation and illustration, the 
procedure described in this section may be displayed in the 
context of a three section relevance tree similar to the 
one used in PATTERN. In this case, the levels (in order) 


are environments, deficiencies, and concepts. If a ranking 
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of the elements on any particular level of the tree is 
considered desirable, suggested criteria for this purpose 
are listed on the left side of Figure 28. 

In summary, while none of the five methods discussed in 
this study are individually adequate for estimating future 
military needs, they can be selectively combined in order to 
provide a coordinated means of performing the several types 
of processes involved. The composite approach presented 
here is designed to "match the tool to the job" by combining 
those methods that appear most useful for managing the par- 
ticular characteristics embodied in each section of the 


conceptual model. 
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V. CONCLUSIONS 


A. SUMMARY OF ANALYSIS 

the purpose of this paper, as stated in the introduction, 
was to systematicaily develop and analyze a generalized 
procedure for estimating future military needs as a basis 
for exploratory R&D planning. In the course of pursuing 
this goal, the study examined three different aspects of the 
needs estimation problem. 

The first portion of the analysis described and analyzed 
the-elements of the problem in the context of a conceptual 
model. The specification of the various inputs as well as 
the comparative assessment, analysis, synthesis, and iterative 
evaluation processes involved in transforming them into 
meecements of need were discussed and illustrated. dn 
addition, an example of the hypothetical operation of the 
model was presented. 

The second portion of the analysis (Chapter Three) 
examined several distinctly different analytic methods by 
discussing BT Oaehes. CO needs estimation which have been 
founded on them. 

Chapter Four dealt with a comparative evaluation of the 
various individual methods in terms of their applicability 
to needs estimation in general and to this study's conceptual 
model in particular. Since none of the individual methods 
appeared capable of adequately dealing with all aspects of 


the problem as delineated in the model, a composite appraach 
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was developed to combine and coordinate several of their most 
beneficial characteristics. This approach is structured in 
an overall relevance tree framework and is designed to 
utilize Delphi and cross-impact techniques in the more 
subjective or judgementally oriented areas plus functional 
network analysis and threat assessment or simulation in 

the objective or easily quantifiable ones. 

The procedure developed in this study provides a system- 
atic methodology for the estimation of future military needs 
an an overall mission-oriented force structure context for 
use as the planning base for allocation of exploratory R&D 
assets. Its output consists of needs statements as described 
in Chapter Two which reflect not only projections of opera- 
tional deficiencies, but also suggestions of connects 


concepts which appear to merit investigation and exploitation. 


B. SUGGESTED AREAS FOR FURTHER STUDY 

This study has not explicitly addressed the tremendous 
difficulties involved in implementing the various methods 
suggested for use in the composite procedure. Therefore, an 
isorvant area of further studies is the actual development 
of the processes required. References 21 and 22 indicate 
that while the problems associated with developing usable 
processes are by no means insurmountable, they are difficult 
and time-consuming. | 

Another equally important area for study involves the 


applicability of the proposed procedure for implementation 


78 





at the various cognizant levels of DoD. Since the included 
tasks must be performed within the existing bureaucratic 
structure, an investigation :of the relevant interfaces in 
This structure would be extremely valuable. In the same 
vein, an in-depth analysis of actual DoD procedures in this 
area would be helpful in determining which of these proce- 
dures are most useful and how they might be improved and/or 
combined to more closely approximate the type of procedure 
proposed in thas "study. #s stated previously, the author 
intends to examine this latter aspect of the problem in a 
related follow-on study which will investigate the existing 
needs estimation procedures within DoD and the manner in 


Which theyemieat be more effectively utilized. 
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